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Abstract 

There has been an increasing trend in the electric power system from a centralized generation-driven 
grid to a more reliable, environmental friendly, and customer-driven grid. One of the most important 
issues which the designers of smart grids need to deal with is to forecast the fluctuations of power demand 
and generation in order to make the power system facilities more flexible to the variable nature of renew¬ 
able power resources and demand-side. This paper proposes a novel two-tier scheme for forecasting the 
power demand and generation in a general residential electrical gird which uses the distributed renew¬ 
able resources as the primary energy resource. The proposed forecasting scheme has two tiers: long-term 
demand/generation forecaster which is based on Maximum-Likelihood Estimator (MLE) and real-time 
demand/generation forecaster which is based on Auto-Regressive Integrated Moving-Average (ARIMA) 
model. The paper also shows that how bulk generation improves the adequacy of proposed residential 
system by canceling-out the forecasters estimation errors which are in the form of Gaussian White noises. 

Keywords : Adequacy Analysis, ARIMA Model, Forecasting Model, Maximum Likelihood Estima¬ 
tion, Smart Grids 

1 INTRODUGTION 

In recent years, increasing awareness about environmental issues and sustainable energy supply introduced 
modern power system, called smart grid (SG), to upgrade conventional power system by utilizing novel 
technologies. There are many influential elements in the SG which helps power grid to achieve a more 
reliable, sustainable, efficient and secure level, such as distributed renewable resources (DRRs), advanced 
metering infrastructure (AMI), energy storage devices, electric vehicles, demand response programs, energy 
efficiency programs, and home area networks (HANs) [U |2]. Furthermore, recent advances in deploying 
communication networks in SG provide two-way communication between utility and electricity consumers 
and improve market efficiency [3]. In a related context, conventional generation resources mostly use fossil fuel 
as their energy source which is a major environmental concern. To overcome this problem, SG will experience 
a high penetration of DRRs which has two main advantages: 1) cost-effective because the main energy source 
is free (wind energy, sunlight, etc), 2) produce no hazardous pollution. Additionally, DRR utilization helps 
power system to become dispersed. Therefore, not only SG is more distributed than conventional power 
system but power generation units are trying to implement green-based energy resources [4]. In order to 
reduce the variability of wind power generation, this reference proposes coordination of wind power plant 
and flexible loadj^. 

One of the most challenging issues in future power system design and implementation is the flexibility of 
power system devices to adapt the stochastic nature of demand and generation Hill. In other words, high 
penetration of DRRs, such as wind power and photovoltaics, is not sufficient to achieve an acceptable level of 
reliability in terms of adequate supply of electricity demand; for instance the output power of wind generators 
requires excessive cost to manage intermittency [5]. Ref [S] proposes a Gonsensus-I-Innovations distributed 
control approach for the distributed energy resources. Consequently, there is a foremost obligation to develop 
an accurate forecasting method to predict the power generation of intermittent DRRs. 

Based on US Energy Information Administration (EIA) assessment, energy demand will increase by 
56% from 2010 to 2040. This astonishing consumption growth is driven by economic development [lOj . 
Additionally, on the demand side, customers demand depends on many factors and there are many studies 
performed in order to achieve an accurate forecast methodology. Load forecast uncertainty plays a pivotal role 
on power system studies such as loss estimation, reliability evaluation, and generation expansion planning. 
Demand forecasting methods including, but not limited to, fuzzy logic approach, artificial neural network, 
linear regression, transfer functions, Bayesian statistics, judgmental forecasting, and grey dynamic models 
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Considering all of the above-mentioned issues, including uncertainty of demand and generation, forecast¬ 
ing errors and DRR intermittent generation profile, proposing an accurate demand/generation forecasting 
scheme is definitely required to achieve a more reliable and secure power grid. In other words, the purpose 
of this paper is to propose a framework in which the SG customers are satished in terms of supplying their 
demand reliably, independent from the wide variation of DRRs’ generation amount. 

1.1 Related Works 

Utilizing green power generation units, DRRs, requires electricity demand/generation forecasting which are 
addressed in recent studies. In [S], deferrable demand is used to compensate the uncontrollable and hard-to- 
predict fluctuations of DRRs. As a result, green-based power generation units can utilize the flexibility of 
the customers to meet demand appropriately. They introduced an efficient solution using stochastic dynamic 
programming implement their method. Moreover, consumer participation in generation side is modeled in 
term of demand response. Implementation of demand response programs brings many advantages for the 
SG: 1) customer participation in generating power, 2) transmission lines congestion management, and 3) 
reliability improvement. In |12) . a flexible demand response model is proposed. This model is useful for 
evaluation customer’s reactions to electricity price and incentives. They defined a strategy success index to 
evaluate the feasibility of each scenario [T^ . 

Additionally, Hernandez et al. performed a comprehensive survey on power grid demand forecasting 
methods considering SG elements. This study classifies load forecasting based on forecasting horizons: very 
short term load forecasting (from seconds to minutes), short term load forecasting (from hours to weeks), 
medium and long term load forecasting (from months to years). The authors also classified forecasting 
methods according to the objective of forecast: one value forecasting (next minute’s load, next year’s load), 
and multiples values forecasting (such as peak load, average load, load profile) [TT] . 

Smart load management studies also require load/generation forecasting to efficiently balance load and 
generation in a near-real time manner. In iia, a multi-agent based load management framework is intro¬ 
duced. This approach considered renewable resources and responsive demand to achieve an acceptable level 
of load-generation balance. For a broader treatment on this, there are some other researches on this topic 
that considered electric energy dispatch in presence of DRRs [HUl]. For a broader treatment on this, please 

see [la [HI [11 [H1201 HD mi 1131121 US HI 113 • 

1.2 Our Contribution 

In this paper, we propose a novel hybrid (two-tier) scheme for forecasting the power demand and generation 
in a residential electrical gird. The grid has expanded over a city consisting of a number of communities. 
Distributed Renewable Resources (DRR), and some bulk generations back-up plan. Our forecasting scheme 
has two tiers: long-term demand/generation forecaster which is based on Maximum-Likelihood Estimator 
(MLE) and real-time forecaster which is based on Auto-Regressive Integrated Moving-Average (ARIMA) 
model (see [MIHUHIISD for related work). In the long-term forecaster, we use the classification of historical 
demand/generation data to build our estimator; while in the real-time one, we predict the time series of 
power demand/generation using a discrete feedback control system which gets feedback from short-term 
previous values. We show that how the bulk generators can improve the adequacy of our residential system 
by canceling-out the forecasters estimation errors which are in the form of Gaussian White noises. 

The rest of this paper is organized as follows. Section 2 represents a general framework of the problem. In 
Section 3 we discuss our proposed two-tier forecasting scheme in both long-term and real-time time horizons. 
A far-reaching adequacy analysis framework is presented in Section 4. Finally, summary and outlook are 
given in Section 5. 

2 PROBLEM SPECIFICATION 

Consider a network of communities in a city. In each community, there are a number of customers and 
a distributed renewable resowrc^ which supplies the energy needed by the customers in the community. 

^An industrial facility for the generation of electric power. The power generator of a distributed renewable resource use 
renewable energy sources. 
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(b) More details inside a community. Arrows represent energy flow. 

Figure 1: Schematic representation of the electric power distribution network. 


Moreover, there are a few power plants which are outside the communities and scattered over the city to 
help the distributed renewable resources generate electricity on demand. Existence of these extra plants 
improves the performance of our electrical distribution system. We refer to these extra power plants as bulk 
generators. The electric energy generated by these generators can be transferred to each community in the 
city through the network of communities schematically represented in Figure [Ta] This figure shows a network 
representation of our described model. As you see, each community has some connected neighbors so that 
it can trade electricity with them if it is necessary. We assume that any two neighbors are connected via a 
two-way transmission power line. 

Consider some community in our example. Each customer located in the community has some amount 
of electricity demand which varies from time to time. Let 'D{q,t) denote the total electricity demand of all 
of the customers in the community at given moment t. Note that T’(g, t) is the instantaneous power that 
have to be supplied at time t. To illustrate, see Figurej^which specihes the daily expected value of T>{q, t) in 
New-England in 2012. Additionally, we use Q{q,t) to represent the total amount of electric power generated 
by the DRR located in the community at given time t. 
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Figure 2: Daily demand profile of New-England in 2012. 


Figure shows more details of a community. As you see, there is a controller unit called Local Load 
Management Unit (LLMU) which controls the energy flow inside the community. Furthermore, the controller 
may participate in the energy distribution of other communities by forwarding the flow received from its 
neighbors. Assuming that the instantaneous generated power {Q{q,t)) of the DRR exceeds 'D{q,t) in a 
period of time, the energy flow of size Q{q,t) from the DRR is divided into two parts: a power flow of size 
I?(g, t) moves towards the customers and the other Q{q, t) — V{q, t) units is stored by the energy storage unit 
embedded in each community. On the other hand, if the value of G{q, t) becomes lower than I?(g, t) in some 
time interval, there will be two main energy flows in the community to satisfy the customers demand: one 
is originated from the DRR; the other of magnitude T>{q,t) — G{q,t) is from the storage unit. Moreover, in 
the case that 'D{q,t) > G{q,t) and there is no enough amount of energy in the storage unit to compensate 
the shortage of DRR generation, there has to be another flow from the neighbors towards the community of 
customers. 


3 OUR PROPOSED HYBRID FORECASTING SCHEME 

In this section, we focus on how to forecast the power demand and generation in short/long-term. At 
the first subsection, we propose a Maximum-Likelihood Estimator for long-term foresting which is crucial 
in the process of low-cost energy flow management and also is a basis for real-time forecasting of power 
demand/generation. In the following subsection, two estimation models will be proposed for real-time 
forecasting of demand and generation. In the first one which is a two-tier hybrid model (based on MLE 
and AR), we assume that the forecast random processes are stationary in few hours; however, the second 
model (which is an ARIMA) is more appropriate for the case that the forecast random processes doesn’t 
show stationary behaviors even in few hours. 

3.1 Long-Term Forecasting 

We assume that there are a set of customers C distributed over an area. By partitioning the area into n 
disjoint parts Ai, A 2 ,..., A„, we obtain a corresponding partition of set C: Ci, C 2 ,..., Cn (communities of 
customers). The demand values of every subset Cq has been measured every u units in time period [0,ru] 
for some integer T and real value u. 

Assume that a year is divided into m parts (school time, Christmas holidays. Summer break, etc) based 
on the similarity of electricity usage pattern. We partition time interval [0, Tu] into m subsets: Ii, I 2 , ■ ■ ■, Im 
such that set A contains the part of every year belonging to [0, Tu]. Additionally, every set A is divided 
to two parts: weekends In and business days 1^2 • Moreover, assuming that a day is divided into d parts 
(again based on the similarity of electricity usage pattern during the day), we partition every interval lij 
into lijl-) Iij 2 i • • • 1 d-ijd- 

In addition, assume that we have the historical weather data in every area Aq over period [0 ,Tm]. 
Considering that W denotes the set of different weather conditions, we partition time interval lijk in the 
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following form for every area Aq\ 


(1) 




{w,q) 

ijk 


wGW 


for every i = 1, 2,... m, j = 1,2, k = 1, 2,..., d, q = 1,2,..., n. Note that in Equationspecifies the 
subset of lijk such that the weather condition in area Aq and time t € is w. 

Now, assuming that interval [0,Tu] contains 5 days, let specifies the day of time interval [OjTu] 
for every v = 1, 2,..., d. Additionally, consider Vi^q, r) as the power demanded by the set of customers Cq 
measured at moment ut (for every r = 0,1,..., T). For every interval H -D„, if ^ 0, 

we specify five parameters: which is the number of years passed since t = 0 (till interval 

which is the number of weeks passed since the begining of the paritition of a year, x'^^ which is the 
number of days passed since the begining of the partition of a week, X^'^ is the temperature in area Aq 
and time interval and 

E 'Diq^r) 


. , 'UtgAA’’'"' 

y(l) — _ 


E 


( 2 ) 




where specifies the average power demanded by the set of customers Cq in time interval ■ 


For every subset C [0, Tu], we construct a maximum-likelihood estimator for the dependent variable 


based on the following linear model: 

= [1 


Ai^)][/3o/3i ... [i,r 


+ N(0,a2) . 


(3) 


Considering that condition ^ 


-h e 


is only true for v = Vi,V 2 , ■ ■ ■ ,Vp, we obtain that = 

Vg = 1,2, ...,n such that /? = [/3*-i]5xi, e = [£i]pxi, and = 


[1 X^'^ Symbol specifies the average power demanded by the set of customers Cq in 

time interval moreover, Aa,..., At 4 denote the parameters on which is dependent (for every 

t = 1,2,... ,p). 

Using the maximum-likelihood method for the linear model mentioned in Equation]^ we obtain that: 


and 


sml = ~ N{0,^mlI) , 


(4) 

(5) 

( 6 ) 


Note that the ML estimator specified in Equation can forecast the average power demand in an interval 
of few hours. However, by using the estimator repetitively and for different intervals we can forecast 

the average power demand for longer time; however, the variance of error will increase respectiveljj^ 

Additionally, the similar estimation model can be made for power generation. The only difference is that 
we don’t need to partition a week into two parts. Moreover, we have to partition a year into small parts 
based on the similarity of power generation pattern. 


^addition of b i.i.d. jointly normally distributed random variables of variance is also a normal variable of variance ba^ . 
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3.2 Real-Time Forecasting 

In the previous subsection, we partitioned the interval [0 ,Tm] into Q{md\W\) subsets in the form of 
(for every set of customers Cq). Additionally, for every subset a maximum likelihood estimator was 

constructed to estimate the average power demanded by customers Cq in time interval H Dy. 

Our ultimate goal in this section is to construct an estimator for the value of power demanded by set of 
customers Cq in moment t = tu (for some integer value r) based on ARIMA(a, 0,0) model with drift 

= Er , (7) 

where is the average of demand value 'D{q, t) in time interval t G which is estimated by Equation 

is a white noise of variance cr^, tu G for some i,j, k, w, v, and L is the lag operator: L{'D{q, t)) = 

'D{q, T — 1). By replacing with + e' where e' ^ -/V(0, ct'^ml), we obtain that: 

a a 

2^(9: t) = (X! 

^ ' V 

estimated value 

( 8 ) 

+ (l>l — 1 )^^ • 

Z=1 

^ "V 

estimation error 


Note that Equation]^ works only if random process 'D{q,t) shows stationary behavior; otherwise, we need to 
use the model with moving average. In fact, assuming that process 'D{q, t) is not stationary, ARIMA(a, 1, 0) 
is much better for short-term forecasting: 

a 

(l-Y,c^iL^){\-L)V{q,T)=ey . (9) 

Z =1 


Consequently, we obtain that: 


t ) = (</>! + l)x>(g, T - 1) 

a 

+ - (t>i-i)'D{q, T-l) 

1^2 

- 4 >a'D{q,T - a-l)+er . 


( 10 ) 


As you see, ARIMA(a, I, 0) model forecasts the demand value using its (a -I- 1) previous values with a white 
noise error. 

In addition, the power generation of the 5 *^ generator can also be forecast using ARIMA(a', 1, 0). As¬ 
suming that G{g,t) specifies the instantaneous power generated by the g*^ generator at moment t, we have: 


a 

(l-^</.;L')(I-A)g(g,r) = 4 ; 


( 11 ) 


Z=1 


or equivalently, 


Gig,T) = {(/)[ + l)g{g,T- 1) 

a' 

+ - <P'i-i)Gi9,r - l) 

1^2 

- 4 >'a'G{ 9 ^T - a - l) + 4 • 


( 12 ) 


In the following section, we analyze the adequacy of the electricity system based on ARIMA(a, I, 0) 
forecasting model. 


6 




4 ADEQUACY ANALYSIS 


By assumption, we consider the maximum security for our electrical facilities (like wires). Henceforth, the 
system reliability in our discussion refers to the system adequacy. In order to analyze the system adequacy, 
we need to use the forecasting models of instantaneous demand and generation presented in the previous 
section:I?(g, t) = I?(g, r) + 0^ and Q{q, t) — Q{q, r) + Gr such that T>{q, t) and Q{q, t) are obtained by the 
ARIMA estimators specified in Equations and additionally, Dt and Gt are two independent Gaussian 
white noises of the following covariance functions (regarding the Central-Limit theorem, the estimation 
errors of the instantaneous demand and generation are Gaussian processes): cav{Ds, Dt) = cr^ • S{s — t) and 
coy{Gs,Gt) = (Tg • d(s - t). 

Now, assume that community Gq uses the renewable power plant (DRR) to satisfy its demand. 
Assuming that at given time t, community Cq has stored S{q,t) units of energy, we obtain that S{q,t) = 
— 'D{q,t'))dt' -I- Sq for every t > 0 such that Sq is the initial stored energy in the community. 
By replacing the generation and demand functions with their equivalent random processes, we obtain that 
S{q,t) = S{q,t)— Wt where S{q,t) = J^{Q{q,t') —V{q,t'))dt' + Sq a,ndyVt = — Gt')dt'. Since and 

Dt are two independent Gaussian white noises, Wt is a Wiener process of variance (cr^ -I- cr^) and covariance 
function cov{yVs,V\it) = min{s,t} • (Cg -I- cr^). Moreover, it is easy to show that the expected value of the 
stored energy at given time t is S{q,t). 

According to the above analysis, the amount of stored energy S{q^t) is equal to the summation of 
deterministic amount S{q,t) and the scaled Wiener process (—W*). In the rest of our analysis, we assume 
that the expected value of the stored energy never becomes less than the initial amount of energy {sq); i.e. 
S{q,t) > Sq for every t > 0. This condition can be held by providing sufficient DRRs for every community 
(which is designed based on long-term forecasting of power demand and generation). 

Here, we define the system adequacy ratio {pq{0,t)) for the q*^ community as the probability that the 
actual stored energy S{q, t') doesn’t meet the low-threshold {sq — A) for some A G [0, Sg] and every t' G [0, t]. 
So, Pq{0,t) = Pr[Vt' < t : S{q,t') > Sg - A] > Pr [Mt < A] where Mt is the running maximum process 
corresponding to the scaled Wiener process Wt- So, regarding the characteristics of the running maximum 


process, we conclude that Pq{0,t) > erf ( ^ _ =) such that = ag + cr^. In other words, we assume that if 

Siq, t) < Sq — X (the stored energy becomes lower than some threshold in the < 7 *^ community), the consumers 
demand will not be satisfied anymore. Figure]^ shows how the lower-bound of the reliability ratio changes 
as parameters A and cr^ get different values. 


Algorithm 1: LocalLoadManagementUnit 


1 

2 

3 

4 

5 

6 

7 

8 

9 


Input: Gommunity Index q & time t 
if S{q,t + 1) < Sq — X then 

I Ask the bulk generations for Sq — S{q,t + I) units of energy; 

end 

if D{q,t) > Q{q,t) then 

Greate an energy flow of size D{q,t) — Q{q,t) originated from the storage unit toward the 
customers.; 

end 

else 

Divide the energy flow originated from the DRR into two branches: one toward the customers and 
the other toward the storage unit, 
end 


As you see in Figure]^ if the DRR of each community is the only source of power for the community 
customers, the adequacy ratio will substantially decrease over time. In fact, even if the DRRs are sufficient 
to satisfy the customers’ demand in long-term(iS(q, t) > Sg), the system adequacy can not be guaranteed 
because of the white noise errors existed in the short-term forecasting scheme of demand and generation. 
Subsequently, we have to get help from the bulk generators located outside the community to cancel out the 
temporary noises and improve the adequacy ratio by generating extra energy on demand. 
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Figure 3: Lower bound of the adequacy ratio of a community for three different values of A and cr^ 


4.1 Canceling out the Noise by Energy Requests 

As mentioned before, if the value of S{q, t) falls below some threshold [sq — A), the system adequacy will be 
endanger. In this subsection, we use the bulk generation as a back-up plan to prevent such event. To do 
this, we design a controller to watch the amount of stored energy in different communities during the time. 
In the case that S{q,t) < Sq — X for the q*^ community, the controller asks the bulk generation to fill the 
gap and cancel out the noise —Wt by providing the community with Wj units of energy. 

Here, we focus on what has to be done by the LLMU specified in Figure The recently explained 
scenario which specified the functionality of LLMU cannot be implemented in the real-world as the values 
of G{q,t) and T>{q,t) are obtained from random processes. This urges us to forecast theses values in short 
term (for example, every 15 minutes). Algorithmshows the practical way of implementing LLMU using 
forecasting models for the q^h community. As mentioned before, by forecasting (estimating) the power 
demand and generation using ARIMA model, we will obtain white noise errors added to the real values of 
G{q,t) and as the estimated values. These noises on the estimated power values will add some errors 

in the form of Brownian Motion processes to the estimated values of stored energy. 

5 SUMMARY AND OUTLOOK 

This paper proposed a novel hybrid scheme for forecasting the power demand and generation in a residential 
power distribution network. Our forecasting scheme had two tiers: long-term demand/generation forecaster 
which is based on Maximum-Likelihood Estimator (MLE) and real-time demand/generation forecaster which 
is based on Auto-Regressive Integrated Moving-Average (ARIMA) model. The paper also showed how bulk 
generation improves the adequacy of our residential system by canceling-out the forecasters estimation errors 
which are in the form of Gaussian White noises. 
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